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METHOD AND SYSTEM FOR CALIBRATING RELATIVE 
FIELDS OF VIEW OF MULTIPLE CAMERAS 




BACKGROUND OF THE INVENTION 



[0001] The present disclosing relates generally a method and system of calibrating 
cameras. More particularly, the present disclosure relates to a method and system of 
calibrating cameras having non-overlapping fields of view. 



[0002] Multiple cameras are calibrated to allow a large space to be observed. Such 
an area may be a room that is under surveillance for security purposes. These 
cameras are often connected to several monitors to be viewed by a security 
professional in a single location. 

[0003] Historically, determining the position and orientation of multiple cameras 
relative to each other has been a difficult and inaccurate procedure. The process 
required placing an object, such as a person, in a common field of view of two 
cameras. However, the irregularly shaped object and common field of view, or 
overlap, constrained the accuracy and limited the breadth of the surveillance system. 

[0004] Accordingly, there is a continuing need to calibrate cameras that do not have 
overlapping fields of view to eliminate one or more of the aforementioned and other 
drawbacks and deficiencies of prior calibration surveillance systems and methods. 



BRIEF DESCRIPTION OF THE INVENTION 



[0005] A method for calibrating cameras is provided. The method includes a moving 
a point of light on a first flat surface. A first and a second camera are provided to 
generate a first frame of the point of light and a second frame of the point of light. 
The respective points of light are in a first field of view and a second field of view of 
the first and the second cameras. The method includes determining a relative position 
between the first and second camera based in part of the first and second frames. 
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[0006] A method for calibrating cameras is provided. The method includes moving a 
point of light. The method also includes generating a first frame when the point of 
light is in a first field of view of the first camera and generating a second frame when 
the point of light is in a second field of view of a second camera; the first and the 
second field of view need not overlap. The method further includes capturing data 
including the times of the first and second frames. The method further includes 
determining a relative position between the first and the second cameras based at least 
in part of the first and the second times. 

[0007] A system for camera calibration is provided. The system includes a light 
source generating a point of light on a flat surface. The system further provides means 
for moving the point of light through a predefined path, such that the path is definable 
through a field of view of the first and second cameras. The system further comprises 
a controller connectable to the first and second cameras so that the controller can 
capture a first frame from said first camera when said predefined path is within a first 
field of view and a second frame from said second camera when said predefined path 
is within second field of view. The system further includes a controller configured to 
determine an angle of the first camera with respect to the second camera based at least 
in part on the first and second frames. 

[0008] The above-described and other features and advantages of the present 
disclosure will be appreciated and understood by those skilled in the art from the 
following detailed description, drawings, and appended claims. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0009] FIG. 1 a top view of a camera calibration system; 

[0010] FIG. 2 is a side view of a light source of FIG. 1; 

[0011] FIGS. 3 through 7 are frames of a field of view of a first surveillance camera; 
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[0012] FIGS. 8 through 12 are frames of a field of view of a second surveillance 
camera; 

[0013] FIGS. 13 through 17 are frames of a field of view of a third surveillance 
camera; 

[0014] FIG. 18 is a side view of a second embodiment of the light source; 

[0015] FIG. 19 is a top view of a camera calibration system using a second 
embodiment of the light source; 

[0016] FIGS. 20 through 22 are frames of fields of view using a second embodiment 
of the light source; and 

[0017] FIG. 23 is a second embodiment of the calibration system having a monitor. 



DETAILED DESCRIPTION 



[0018] Referring now to the drawings and in particular to FIG. 1, an exemplary 
embodiment of a camera calibration system generally referred to by reference numeral 
10 is illustrated. For the purposes of this invention, calibration means the orientation 
and/or position of cameras. System 10 has very few components configured to 
calibrate cameras observing flat surface 20. System 10 has a light source 15 to 
project a point of light 70 through a known trajectory such as a circle 65 and a 
controller 25 to collect data, coordinate multiple cameras and to compute relative 
camera positions. System 10 can calibrate numerous cameras; however, for purposes 
of illustration, three surveillance cameras 35, 40 and 45 are shown. Each camera 35, 
40 and 45, has a respective field of view 50, 55 and 60 on flat surface 20. 
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[0019] Referring now to the drawing of FIG. 2, a side view of a light source 15 is 
shown. Light source 15, is capable of projecting point of light 70 on flat surface 20. 
Point of light 70 could be from any light source; however, the most accurate 
calculations will be achieved by using a light source capable of producing a focussed 
point on surface 20. Further, light source 15 projects point of light 70 through circle 
65, a mathematically describable trajectory. Light source 15, is moved by a rotating 
device; however, any other device such as an oscillating device, could be used if it 
projects point of light 70 in a mathematically describable trajectory. In the exemplary 
embodiment of FIG. 1, light source 15 is configured to move at a constant rate of 5 
RPM and controller 25 is configured to operate cameras 35, 40 and 45 to capture 12 
seconds of video data or 360 frames of data at a rate of 30/frames per second for each 
camera. 

[0020] Referring to FIG. 1, surface 20 can be any flat surface including for example a 
wall, a ceiling or a floor. In FIG. 1, light source 15 projects point of light in circle 65; 
however, any mathematically describable trajectory such as an ellipse, a parabola or a 
line could be used. Also, light source 15 projects point of light 70 into fields of view 
50, 55 and 60. Cameras 35, 40 and 45 are mounted at an angle with respect to an axis 
perpendicular to flat surface 20; therefore projected point of light 70 will appear to 
move in an ellipse instead of a circle. 

[0021] Referring now to FIGS. 1, 3-17, controller 25 and each camera 35, 40 and 45 
are capable of being operatively connected to exchange data. Controller 25 captures 
data from FIGS. 3-14, representing frames from each camera, including those frames 
containing an image of the point of light in fields of view 50, 55 and 60. Controller 
25 also captures the time each frame-is taken for each respective camera. Each 
camera 35, 40 and 45 has a known focal length and a charge coupled device or other 
imaging device of known size that allow controller 25 to make calibration 
computations. 

[0022] Referring to FIGS. 1 and 3, for each camera 35, 40 and 45, controller 25 
creates coordinates of a point of light from the field of view of each camera frame in 
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which point of light 70 appears. For example, in FIG. 3, controller 25 creates 
coordinates for point of light 70. For circle 65, controller 25 must capture at least four 
frames from each camera containing point of light 70 to generate coordinates, because 
four points uniquely define an ellipse. For other trajectories, two points could be used 
to define the trajectory. Controller 25 can then calculate for each camera an ellipse 
described by the four points of light that passed through their respective fields of 
view. Controller 25 is capable of calculating the angle in between cameras 35 and 
40, with respect to the center of circle 65 by knowing the time a particular frame from 
camera 35 captures point 70 and where point 70 would be located at that same time 
along the ellipse viewed by camera 40. 

[0023] Figures 3 -7 represent frames of field of view 50 of camera 35. For example, 
at time t=l and t=27, point of light, 70 appears in field of view 50 represented by 
FIGS. 3 and 4. At t=l and t=27, the same point of light 70 does not appear in FIGS. 8 
and 9 representing frames of field of view 55 for cameras 40. At t=l and t=27, the 
same point of light 70 also does not appear in FIGS. 13 and 14 representing frames of 
field of view 60 for cameras 45. Similarly, at time t=106, point of light 70 appears in 
fields of view of 55 and 60, or FIGS. 1 1 and 16, respectively. 

[0024] The method of the invention will be explained by way of example. In 
reference to FIG. 1, a first camera 35 and a second camera 40 are oriented to have 
fields of view 50 and 55, respectively, on flat surface 20. The fields of view 50 and 
55 do not overlap. Knowing the focal length of each lens, the size of the imaging chip 
and geometric relationships between cameras 35 and 40 and flat surface 20, respective 
distances from the center of circle 65 can be determined. Cameras 35 and 40 are then 
calibrated with respect to each other by based in part on capturing frames of data for 
each camera in which point of light 70 appears. For example, in FIG. 1, calibrating 
cameras 35 and 40 is accomplished, by knowing the location of point 70 at frames 
t=l through t=30 in field of view 50 and where on the ellipse in field of view 55 point 
70 would appear at frames t=58 through t=106. Of course, other trajectories could 
be used to generate similar points of light 70 having different trajectories in frames. 
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[0025] The calibration system 10 can calibrate cameras 35 and 40 whether their fields 
of view overlap or not. For example, system 10 can also calibrate cameras 40 and 45, 
that have overlapping fields of view 55 and 60, respectively. System 10 can calibrate 
cameras having respective fields that overlap entirely at 100% or not at all. 

[0026] Referring now to FIGS. 19-22, an alternative embodiment of light generation 
source 15 is shown. In this embodiment, light source 15, contains a beam splitter, 75 
such as a diffraction grating. Beam splitter 75 is placed in front of light sources to 
create four points of light 85, 90, 95 and 100 that area geometrically related. Beam 
splitting allows more points of light to be collected by controller 25 from each frame; 
therefore, increasing the accuracy of final positioning results. 

[0027] A second exemplary embodiment of calibration system 10 is described with 
reference to FIG. 20. Again, system 10 has cameras surveillance 35, 40 and 45, light 
generating source 15, and controller 25. System 10 also includes a security monitor 
105 to show a synthetic image 110, flat surface 20, and a connection 1 15 to connect 
controller 25 to monitor 105. Once the light generating source has completed camera 
calibration, it is not needed for any synthetic image generation. Synthetic image 110 
is created by appropriate software for such applications resident on controller 25. 
Synthetic image 1 10 is a real-time virtual image that can be supplied with actual 
images of people, for example, as they pass over flat surface 20. Image 110 does not 
require overlapping fields of view for its creation. In this embodiment, a security 
professional can view monitor 105 and observe flat surface 20 at one time in synthetic 
image 110, instead of viewing the flat surface 20 as a series of actual camera images 
on multiple monitors. 

[0028] Modeling is another application for system 10. In this application, controller 
25, captures data from FIGS. 3-17 and generates three-dimensional constructions of 
actual three-dimensional objects on flat surface 20. For example, if a person walks 
over flat surface 20, a synthetic image of flat surface 20 would be generated and the 
person would be passing through the synthetic image. If only a side view of the 
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persons's face were visible, controller 25 would manipulate the data to generate a 
three-dimensional rendition of that persons face. 

[0029] While the instant disclosure has been described with reference to one or more 
exemplary embodiments, it will be understood by those skilled in the art that various 
changes may be made and equivalents may be substituted for elements thereof without 
departing from the scope thereof. In addition, many modifications may be made to 
adapt a particular situation or material to the teachings of the disclosure without 
departing from the scope thereof. Therefore, it is intended that the disclosure not be 
limited to the particular embodiment(s) disclosed as the best mode contemplated for 
carrying out this invention, but that the invention will include all embodiments falling 
within the scope of the appended claims. 
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